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5 FIELD OF THE INVENTION 

This invention relates generally to digital image processing systems, and more 
particularly to a method for selecting which rendering hint or tag to use when multiple 
tags may be associated with a pixel. 

10 BACKGROUND OF THE INVENTION 

In digital image processing systems, each pixel is typically represented by a 
numeric value specifying the color of that element. These contone (color) pixel levels 
are generally continuous from one pixel to another. In some systems however, there 
are additional numeric values called "tags" associated with each pixel, which may 

15 describe how the pixel is to be rendered. For example, these tags (known also as 
"rendering intents" or "rendering hints") may specify to the rendering stage which 
halftone is to be used for a printing application. In contrast to the contone (color) 
pixel levels, where color values are continuous, adjacent tag values are in general not 
related. For example one pixel on the border of one object may have a tag value of 5 

20 (150 cluster dot) associated with it. An adjacent pixel, which is associated with 
another type of object may have a tag value of 6 (300 line screen). The tag values of 5 
and 6 are close, but the rendering hint they each refer to provide significantly different 
rendering outputs. 

If the digital image processing system produces the image in its original 
25 format, i.e., including all pixels, each pixel is rendered according to the correct tag. 
However, in some applications, it may be necessary to filter the original image prior to 
rendering. For example, a user may wish to print a "draft" version or lower resolution 
version or a user may wish to print a monochrome version rather than a full color 
version, etc. General filtering (when an image is being reduced in resolution or size, 
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for example) involving the contone data is very straightforward, as the final pixel 
color is simply a weighted sum of the surrounding pixel color values. However, 
filtering of the tag data plane presents a far more difficult problem, due to the lack of 
correlation between tag levels. Applying a weighted sum of the surrounding pixel tags 
5 may not produce a clear answer if there are tag values of 5 and 6 present in the 
filtering window. If there are tag values of 1 and 9 in the filter window, an entirely 
inappropriate tag may be chosen. 

SUMMARY OF THE INVENTION 

10 A method for selecting which rendering hint or tag to use when multiple tags 

may be associated with a pixel, according to one aspect of the invention, includes 
providing an original image comprising a plurality of input pixels, wherein each input 
pixel has input contone data associated with it and an input tag associated with it, 
wherein the original image has a predetermined set of input tags associated with it; 

15 prioritizing the predetermined set of input tags, such that each input tag has a unique 
priority relative to other input tags in the set; filtering the original image by selecting 
groups of input pixels, applying a filtering function to the contone data associated with 
each selected group of input pixels, and producing an output pixel having an output 
contone data for each selected group of input pixels; and for each selected group of 

20 input pixels, comparing the priorities of the input tags associated with the selected 
group of input pixels and selecting as the output tag associated with the output pixel, 
that tag with the highest priority. 

In accordance with another aspect of the invention (i.e., one which processes 
only tags and not contone data), a method for selecting which rendering hint or tag to 

25 use when multiple input tags are used to create a single output tag, comprising; 
providing an original image comprising a plurality of input pixels, wherein each input 
pixel has an input tag associated with it, wherein the original image has a 
predetermined set of input tags associated with it; prioritizing the predetermined set of 
input tags, such that each input tag has a unique priority relative to other input tags in 
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the set; for each selected group of input pixels, comparing the priorities of the input 
tags associated with the selected group of input pixels and selecting as the output tag 
associated with the output pixel, that tag with the highest priority. 

The selected group of input pixels may be at least two adjacent pixels. 
5 Alternatively, selected windows of pixels may be used, for example a 2 by 2 window 
of four pixels, a 3 by 3 window, a 10 by 10 window. Pixels in the selected window 
will in most cases be adjacent, however, in some applications, it may be useful to look 
at pixels outside the selected group or to only consider a subset of the adjacent pixels 
within the selected group. The filtering function which filters the contone data may be 

1 0 any type of filter, such as a box filter or a gaussian filter. 

In accordance with another aspect of the method, the tag merge function, for 
each selected group of input pixels, may further include applying a weighting function 
to the input tags associated with the selected group of input pixels, and for each input 
tag computing a score comprising the product of the weighting function and the 

1 5 priority for that input tag, and selecting as the output tag associated with the output 
pixel, that tag with the highest score. The contone filtering function may include a 
plurality of filtering coefficients and the weighting function may include the plurality 
of filtering coefficients. The weighting function may also include the number of input 
pixels having the same tag within the selected group. 

20 If an input pixel has more than one tag associated with it (for example, there 

may be families of tags associated with each pixel color tags, moire tags, contour tags 
and gradation tags), the method may be applied to each type of tag in order to select an 
appropriate tag for each tag type. 

The method may be used to merge rendering intents in an anti-aliasing filter 

25 from 1200 dpi to 600 dpi. It can also be used in other tag-specific applications, for 
example interpolation of the tag channel in a printer with a "half-res" mode. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 



Digital image processing systems generally represent pixel values as numbers 
that correspond to the color of that pixel. A simplified example of such a 
representation is shown below in Table la, where the pixel values refer to darkness (0- 
5 255). Each level of darkness is related to the surrounding levels, making filtering 
operations on this data straightforward: the filtered (output) value for each pixel is a 
weighted sum of the surrounding pixel values. For example, applying a 3X3 box filter 
to the contone data shown in Table la results in an image having pixels values shown 
in Table lb that is similar to the original. 

10 
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Table la is a gray level presentation of contone image data, where increasing 
15 values correspond to increasing darkness. In Table lb, after application of a 3X3 box 
filter results in an image that is similar to the original. 

In some systems, there are additional image "tags" (also known as "intents" or 
"hints") that are associated with each pixel. These tags describe how the pixel is to be 
rendered. For example, in printing systems, this tag may refer to the halftone used for 
20 rendering. In general, adjacent tags are not related, so continuity is not present as it is 
with the contone data. Exemplary tags are shown below: 
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Function 


Tag Value 


75 Cluster Dot 


0 


100 Cluster Dot 


1 


50 Line Screen 


2 


150 Cluster Dot 


3 


175 Cluster Dot 


4 


75 Line Screen 


5 


50 Cluster Dot 


6 


600 Line Screen 


7 


300 Cluster Dot 


8 


200 Line Screen 


9 


300 Line screen 
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The pixels with contone data values shown in Table la may have associated 
tag values as shown in Table 2a. Applying the same filtering to the tag plane as was 
performed in Table lb leads to disastrous results (Table 2b) - "averaged" tag values 
5 which force rendering with completely different screens. 



0 


0 


0 


0 


0 


0 


0 


0 


9 


9 


9 


9 


9 


9 


9 


9 


Tab) 


e2a 


0 


0 


0 


0 


3 


3 


3 


3 


6 


6 


6 


6 


9 


9 


9 


9 


Tab! 


e2b 



5 



In Table 2a, tag values correspond to the pixels in Table la. Table 2b 
illustrates the result of filtering the tag values of Table la using the same 3x3 box 
filtering as that for the contone pixels. The softened edges (70, 140) in the contone 
data of Table lb would be rendered with the 50 or 150 cluster dot screens, whereas the 
5 rest would be rendered using the 200 line screen, creating severe image quality 
artifacts. 

The method of the invention solves these problems and employs a tag merge 
function: 



where T™ are the input tags, and w- are the corresponding weights. The weights may 

be different, as in the case of a bilinear/bicubic interpolator, or they may be equal, as 
in the case of a box filter or in the simplest case, they may be unity. The only 

1 5 requirement for this function is the output tag must be one of the input tags. 

For example, the tag merge module may include a merge function which is a 
score-based system. A priority table may be established by the user. Priority may be 
determined in a variety of manners depending on the user's applications. For 
example, one priority table may include defining priority by assigning the tag value 

20 associated with the largest number of pixels associated with the highest priority. 
Another priority table may prioritize tags according to a desired output rendering. For 
example, one priority table may be prioritized to favor tags which enhance edge 
rendering around text. However, in any priority table, no two tag values can receive 
the same priority. An exemplary priority table is shown in Table 3. 
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Tag Value 


Function 


Priority 


0 


75 Cluster Dot 


10 


1 


100 Cluster Dot 


1 


2 


50 Line Screen 


3 


3 


150 Cluster Dot 


8 
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175 Cluster Dot 


15 


5 


75 Line Screen 
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50 Cluster Dot 
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600 Line Screen 


12 
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300 Cluster Dot 


2 
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200 Line Screen 
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10 


300 Line Screen 


7 



Table 3 



Referring back to the example of an input image which is filtered by a 3 x 3 
box filter. In this case, blocks of 9 input pixels are averaged to produce one output 

5 pixel. In the case of the contone data, 9 input pixel values are averaged to provide the 
contone data for the single output pixel. The output tag is determined by examining 
the tags of the 9 input pixels. The priority of each input pixel is determined. In the 
simplest form of the tag merge function, the output tag is simply the tag with the 
highest priority. In accordance with another form of the tag merge function, the 

10 output tag which is repeated the most times in the block of 9 pixels. For example, if 
the block of 9 pixels contains five pixels with tag value 5 and four pixels with tag 
value 6, the output pixels will be provided a tag value of 5. 

In accordance with another form of the tag merge function, for each input tag 
value, the priority is multiplied by a weight, to create a "score" for that tag. For 

15 degenerate tag inputs, the weights may be combined prior to computation of the score. 
Once the score is computed, the tag with the highest score is that which is assigned to 
the output tag. In the Table 4, the output would receive a tag value of 5. In the rare 
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case where identical scores are computed for two different tags, the algorithm may 
chose the tag with the higher priority as specified in the priority table. 



Tag Value 


Function 


Priority 


Input Tag Weight 


Score 


0 


75 Cluster Dot 


10 


0 


0 


1 


100 Cluster Dot 


1 


0 


0 


2 


50 Line Screen 
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0.1 


0.3 


3 


150 Cluster Dot 
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0 


0 


4 


175 Cluster Dot 


15 


0 


0 ! 


5 


75 Line Screen 


9 


0.4 


3.6 


6 


50 Cluster Dot 


6 


0 


0 


7 


600 Line Screen 


12 


0.2 


2.4 


8 


300 Cluster Dot 


2 


0 


0 


9 


200 Line Screen 


5 


0 


0 


10 


300 Line Screen 


7 


0.3 


2.1 



Table 4 



In the example of Table 4, each tag has a different weight coefficient. As 
noted before, the weight coefficients may be the same as those of the filtering 
function, which filters the contone data portion of the input pixels. Note that tag value 
5 had a priority of 9 and a weight of 0.4. Tag value 4 (with a priority of 15) was not 
present in this particular group of input pixels. 

This method can be extended in the case of bit field tags, or "rendering intents" 
where a multiple bit value is partitioned and used to represent several tag "families". 
Each family is assumed to be independent (orthogonal) relative to the other families: 




FamilyO Family 1 Color Moire C G 
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where C is Contour and G is Gradation. The number of bits consumed by each family 
is determined by the total number of fields in that family. For example, the "Contour" 
family may only have two states (yes, no) and will consume only one bit, whereas the 
"Color" family may have 30 fields and will consume 5 bits. 
5 When multiple intents are to be merged, each family is merged independently 

according to the tag merge method described above. The final intent is then obtained 
by ORing the merge result of each of these families. 

The method described above may be used to merge rendering intents in an 
anti-aliasing filter, where run length encoded data (containing color and rendering 

10 intent information) originally at a high resolution (e.g., 1200 dpi) are reduced to the 
IOT resolution (e.g., 600 dpi). The method may also be used in the case where pixel 
hints (i.e., a separate map containing tags for each pixel) exist and some filtering 
operation needs to be performed on the image data, for example in a "half resolution" 
mode, where data (contone and tags) are stored in a compressed form at a lower 

15 resolution (e.g., 300 dpi), and later subjected to interpolation in order to scale up to 
printer resolution (e.g., 600 dpi). 

The invention has been described with reference to particular embodiments for 
convenience only. Modifications and alterations will occur to others upon reading and 
understanding this specification taken together with the drawings. The embodiments 

20 are but examples, and various alternatives, modifications, variations or improvements 
may be made by those skilled in the art from this teaching which are intended to be 
encompassed by the following claims. 
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